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Introduction 

The rapid expansion of mobile networks 
globally, coupled with the decreasing cost 
of mobile equipment [1], is allowing global 
health programs increasingly to utilize 
mobile- and cloud-based technology in 
their efforts to target important challenges 
to public health. Our initial electronic data 
collection system employed personal digital 
assistants (PDAs) [2,3], but these proved to 
have significant cost and scalability limi- 
tations. The present report describes a 
second-generation, more efficient, cloud- 
based, smartphone-based system and the 
key elements that lead to its greater 
efficiency. 

The LINKS System 

While there are a number of tools 
available for data collection (EpiCollect, 
FormHub, Epilnfo, and others), these 
tools were not ideal for our purposes 
because of either license restrictions or 
other challenges. The starting point for the 
new mobile application, called the LINKS 
system (Figure 1), was the open source 
project Open Data Kit (ODK) [4,5]. 
ODK allows the collection of a wide range 
of data using only the internal components 
of smartphone devices, such as the built-in 
GPS and the camera that can be used as a 
barcode scanner. 

A server-based application (app) pro- 
cesses incoming data and writes those data 
to a database. A dynamic web interface 
was developed to present the collected 
data to the user in the form of tables, 
graphs, maps, and downloadable datasets. 
The system was deployed on Ubuntu 
Linux, running on Amazon.com's Elastic 
Cloud (AWS EC2, http://aws.amazon. 
com/ec2/) infrastructure. Geotrust secure 
certificates were installed to encrypt the 
data during transmission and between the 
user's browser and the server. Data are 
managed through a web interface or 
downloaded for offline use outside of the 
system. 

The LINKS system was initially devel- 
oped to address shortcomings of the earlier 



PDA-based data-capture systems and to 
support the interests of the Neglected 
Tropical Diseases (NTDs) community in 
employing an integrated approach to the 
NTDs using shared technical platforms. 
The LINKS system can 

• support mobile technology running 
on a wide range of locally accessible 
hardware 

• be used in both highly connected 
(internet) and connection-poor settings 

• have a mechanism to deploy addition- 
al surveys to equipment already in the 
field 

• be built entirely with industry-standard 
open source software to avoid cosdy 
licensing fees 

• be cloud-based to allow for centralized 
management and increase scalability 
for large, highly dispersed projects 

Since its launch in June of 2011, the 
LINKS system has been deployed to over 
20 countries by multiple partner organi- 
zations (Table 1). Upon the completion 
of each project, both data collectors and 
project managers assessed its usability 
and the perceived benefits as well as the 
challenges to using the LINKS system 
(Table 2). This survey was administered 
to 30 individuals across academic and 
government organizations. Feedback was 
received from staff in Ethiopia, Tanzania, 
Kenya, Mozambique, Nigeria, Dominican 
Republic, and Indonesia. Additional feed- 
back was received from implementing 



partners in the United States and United 
Kingdom. 

Cost savings were an immediately 
recognized benefit to deploying an app- 
based system that could run on any 
Android device (Table 3). The system was 
developed using open source applications 
and deployed on cost-effective cloud-based 
hosting. Acquisition costs of individual data 
collection devices were cut in half (and 
have continued to decrease), and shipping 
costs were also reduced by approximately 
half as there was not only less equipment 
(weight) being used but also no longer a 
need to ship equipment back to the central 
office for reprogramming before the next 
deployment. Training savings, too, were 
realized, because the system mirrors the 
existing paper forms and, compared to 
PDA systems, does not require extensive 
practice navigating multiple steps either to 
enter data or to send data to the server. 
Training costs are anticipated to be further 
reduced in the future as video-based 
training is introduced through websites 
such as YouTube (www.youtube.com). 

Data quality is another important do- 
main for evaluation. Routinely, the quality 
of the data has been assessed by reviewing 
the number of errors detected in the 
submitted data during the course of the 
project. The LINKS system automatically 
enforces point-of-source data checks (range 
checks, required variables, logical rules, 
etc.) to keep data errors to a minimum; 
however, detectable errors still exist. 
The largest LINKS project, the Global 
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Figure 1. LINKS system technology overview. Data flow from the point of entry (cellular phones/tablets), to encrypted transmission to the 
cloud, to access and management of the data through a web interface. 
doi:1 0.1 371 /journal.pntd.0002654.g001 



Trachoma Mapping Project (GTMP), 
is currently mapping the prevalence of 
trachoma in areas were trachoma infection 
is suspected. Over the next two years 
this project will evaluate over 4 million 
individuals in over 1,200 districts. Over 
the past 1 1 months, during which 1 million 
individuals were surveyed, this multina- 
tional project has seen a daily error rate 
ofO.14% (two errors/ 1,430 submissions). A 
future comparison of error rates between 
paper and other electronic data collection 
systems would be highly beneficial to 
validate the LINKS system further. 

Finally, we evaluated the time between 
the end of data collection and implemen- 
tation of results. A non-cloud-based system 



requires manual synchronization of data 
using local laptop computers, adding time 
and equipment. In contrast, a cloud-based 
system automatically synchronizes the data 
direcdy from the smartphones whenever 
connected to the internet, allowing data 
managers to identify and communicate 
issues with the field team during the 
collection of data. This allows data from 
all projects sites to flow from collection to 
implementation more rapidly. In the case 
of the GTMP, results take, on average, 
three days from the end of data collection to 
be included in public programmatic tools 
and for program implementation planning. 

In addition to all that has been learned 
with this system over the past two years, it 



is important to note that mobile connec- 
tivity in remote areas (while sometimes still 
a challenge) is not an impediment to the 
implementation of these technologies. 

Challenges Remaining 

Experiences with the LINKS system 
have also identified a number of persistent 
challenges to implementing a mobile- 
based system. Most notably, the essential 
network requirement of such a system can 
prove demanding in certain environments. 
While workarounds such as storing data 
locally until a connection is available are 
now feasible, many of these connectivity 
challenges will also likely solve themselves 



Table 1. Implementation of LINKS system from June 2011 -Aug 2013 





Organization 


Country where deployed 


Purpose of collection 


Number of 
data collectors 


Duration of project 


Number of 
records collected 


The Task Force for 
Global Health (LFSC) 


Dominican Republic, 
Indonesia, Malaysia, Philippines, 
Sri tanka, Tanzania, Togo, 
Tonga, Uganda, Vanuatu 


tymphatic filariasis 
operational research (OR) 


50 


1 year 


> 100,000 


Sight Savers 
International (DFID) 


Egypt, Ethiopia, Nigeria, 
Malawi, Yemen 


Trachoma identification (Global 
Trachoma Mapping Project) 


200 


Ongoing (1 1 months) 


> 1,000,000 


Washington University 
(DOLF) 


Indonesia, tiberia, 
Republic of Congo 


tymphatic filariasis, Soil 
Transmitted Helminths (STH) OR 


25 


2 years 


>76,000 


The Carter Center 


Nigeria 


Trachoma, STH OR 


40 


Ongoing (4 months) 


>200,000 


RTI International 
(USAID) 


Mozambique, Tanzania, Uganda 


tymphatic filariasis mapping, 
Trachoma mapping, OR 


15 


Ongoing (4 months) 


>25,000 


Centers for Disease 
Control and Prevention 
(CDC) 


Haiti, Kenya, Mozambique, 
Nigeria, Tanzania 


tymphatic filariasis OR, 
Drug distribution coverage. 
Nutrition survey 


30 


various 


> 100,000 


University of Georgia 
(SCORE) 


Cote d'ivoire 


Schistosomiasis OR 


10 


Ongoing (2 months) 


> 6,000 


Liverpool University 


Ethiopia 


tymphatic filariasis, 
Podoconiosis mapping 


80 


Ongoing (1 months) 


>2 1,000 


IMA World Health 


Haiti 


MDA Coverage and 
knowledge about treatments 


20 


3 months 


> 18,000 



doi:1 0.1 371/journal.pntd.0002654.t001 
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Table 2. Interview results. 





Staff 


Question 


Cited feedback results 



Data collectors Do you find the LINKS system easier to use than the EDGE system? + Ease of entry 





+ New synchronization method 




(versus laptop connected synchronization) 


+ Local language surveys 


Do you find the LINKS system easier to use 


— Lack of ability to modify form in the field 


than standard paper forms? 




+ Lack of data entry 


+ Automatic skip patterns 


Did you find the entry of data difficult using mobile devices? 


— Gesture navigation as a challenge 


— Small keyboard 


— Challenge of scanning barcodes 


Program managers Do you find the online access to your data as a 


— Concerns over ownership 


convent way to access, share, and manage data? 






— Concerns about needing internet access to 




access and manage data 


Do you find the real-time reporting useful 


+ Capability of program monitoring while 


to monitor the field work? 


away from the project location. 


Would you want to use the LINKS system for other projects? 


— Dissatisfaction in using shared system 




versus system running in country 




+ Speed at which data could be reviewed 




and used for implementation 


Did you find the deployment of LINKS difficult? 


— Challenge of mobile data configuration 



+ Single device as much easier than EDGE multiple components 



doi:1 0.1 371 /journal.pntd.0002654.t002 



Table 3. Cost comparison between previous PDA system and LINKS. 







Earlier, PDA-based system 


Cost 


LINKS System (smartphone/tablet) 


Cost 


Data collection 


* HP iPAQ 211 PDA - 


$200 USD 


Android smartphone 


$200 USD 




* Compact Flash GPS 


$30 USD 








* Secure Digital 


$20 USD 








* Laptop 


$300 USD 






Data transmission to 
central server 


Wired Internet connection 
following synchronization 
to laptop 


$0 


Cellular data service or Wi-Fi connect 


$5-$10/month/phone 
($0 if Wi-Fi used) 


Average equipment cost 
per project (assumes 
5 data collectors) 




$4,000 




$1,000 


Central server 


Microsoft Windows 2000 running 
Microsoft SQL Server 5.0 


$10,000 USD software 
and hardware 


Amazon Elastic Cloud Ubuntu 
running all open source software 


$6,000 USD/year 


Typical number of days 
needed for training 


5 




2 




Replacement equipment 


Shipped from central office 




Locally procured 




Training time (per diem 
costs) 


5 days 


~$5,000 USD 


2 days 


~$2,000 USD 


Redeployment 


Equipment needed to be 


~$1,000 USD 


Ship directly to next project site 


~$500 USD 



shipped back to central office 
for reprogramming and software 
installation before shipping to 
next project site 



doi:1 0.1 371 /joumal.pntd.0002654.t003 
PLOS Neglected Tropical Diseases | www.plosntds.org 



3 



April 2014 | Volume 8 | Issue 4 | e2654 



as the marketplace becomes increasingly 
dependent on widespread internet and 
cellular connectivity. 

A further challenge with the cloud- 
based service model is the concern over 
data ownership, specifically, the acknowl- 
edgment that data is the sole property of 
the principal organization (e.g., national 
Ministries of Health) regardless of where 
the data are being stored. Similar efficien- 
cies have been achieved from using a 
central cloud-based system in other tech- 
nical services, such as e-mail and file 
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